Claims 

1 . (Currently Amended) A method, comprising: 

determining, by a computing device, whether two or more samples of a 
presentation are processed by a first component of a pipeline at an expected time 
based on a first timing error for a first sample and a second timing error for a second 
sample , the two or more samp l es comprising a first sample being and a l ater processed 

error for the f i rst samp l e and a second t i ming error for the second samp l e ; 

requesting, by the computing device, a second component of the pipeline to alter 
[[the]] a manner in which the second component processes a portion of the presentation 
when the two or more samples are not processed at the expected time and when the 
first timing error is greater than the second timing error, the altering including taking 
corrective action to reduce a quality of video filtering of the presentation and reduce a 
quality of audio decoding of the presentation, wherein the portion of the presentation 
comprises at least one succeeding sample to the two or more samples; and 

taking the corrective action by the second component in response to the 
requesting, wh e r ei n the second component comprising one of at least three i s s ele ct e d 
from a group compr i s i ng mu l t i p le components of the pipeline that are configured to take 
the corrective action in response to the requesting . 

2. (Original) A method as recited in claim 1, wherein the first component 
comprises a media sink. 
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3. (Original) A method as recited in claim 1, wherein the second component 
comprises a codec. 

4. (Original) A method as recited in claim 1, wherein the first component 
comprises a media sink and the second component comprises a codec. 

5. (Canceled). 

6. (Canceled). 

7. (Original) A method as recited in claim 1, wherein the portion of the 
presentation comprises a frame. 

8. (Previously Presented) A method as recited in claim 1, wherein 
determining whether the two or more samples are processed at the expected time 
comprises comparing a timing value in each of the two or more samples to a 
predetermined time frame associated with the presentation. 

9. (Previously Presented) A method as recited in claim 1, wherein 
determining whether the two or more samples are processed at the expected time 
comprises comparing a timing value in each of the two or more samples to a 
presentation clock. 
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10. (Previously Presented) A method as recited in claim 1, wherein 
determining whether the two or more samples are processed at the expected time 
comprises determining whether a respective timing value in the two or more samples 
was processed by the first component at the time specified by the respective timing 
value. 

11. (Previously Presented) A method as recited in claim 1, wherein 
determining whether the two or more samples are processed at the expected time 
comprises determining whether a respective timing value in each of the two or more 
samples was processed by the first component within a given time of a time specified by 
the respective timing value. 

12. (Previously Presented) A method as recited in claim 1, wherein 
determining whether the two or more samples are processed at the expected time 
comprises determining if the first sample is processed by the first component at a first 
expected time and determining if the second sample is processed by the first 
component at a second expected time. 

13. (Previously Presented) A method as recited in claim 1, wherein 
determining whether the two or more samples are processed at the expected time 
comprises: 

determining the first timing error as a difference between a time at which the first 
sample is processed by the first component and a time at which the first sample is 
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expected to be processed; and 

determining the second tinning error as a difference between a time at which the 
second sample is processed by the first component and a time at which the first sample 
is expected to be processed. 

14. (Previously Presented) A method as recited in claim 1, wherein the first 
sample comprises an associated first timing value and the second sample comprises an 
associated second timing value and wherein determining whether the two or more 
samples are processed at the expected time further comprises determining whether the 
first timing value more closely corresponds to a time at which the first sample is 
processed by the first component than the second timing value corresponds to a time at 
which the second sample is processed by the first component. 

15. (Previously Presented) A method as recited in claim 1, wherein altering 
the manner in which the second component processes the portion of the presentation 
comprises dropping the at least one succeeding sample. 

16. (Previously Presented) A method as recited in claim 1, wherein the 
portion of the presentation comprises a plurality of frames, wherein altering the manner 
in which the second component processes the portion of the presentation comprises 
dropping a subset of the plurality of frames, wherein the subset comprises two or more 
frames. 
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17. (Currently Amended) A method as recited in claim 1, wherein the first 
component is a media sink, the second component is a codec, and [[the]] wherein 
altering the manner in which the second component processes a portion of the 
presentation comprises dropping at least one frame of the presentation. 

18. (Previously Presented) A method as recited in claim 1 , wherein: 

the pipeline comprises a media source, a media sink, and a topology of media 
processing nodes; 

the first component is a node in the topology; and 
the second component is the media sink. 

19. (Previously Presented) A method as recited in claim 1 , wherein: 

the pipeline comprises a media source, a media sink, and a topology of media 
processing nodes; 

the first component is a node in the topology including a codec; and 
the second component is the media sink. 

20. (Currently Amended) A method, comprising: 

determining, by a computing device, [[if]] when timeliness of sample processing 
in a multi-component pipeline is degrading , the dotorm i nat i on be i ng made based on 
processing times of a first sample and a second sample of a presentation , th e 
d e t e rm i nat i on compr i s i ng by calculating a first timing error for the first sample and a 
second timing error for the second sample; and 

altering, by a component in the multi-component pipeline of the computing 
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device, a manner in which the component processes a portion of the presentation when 
the timeliness of the sample processing is determined to be degrading, the altering 
including taking corrective action by reducing a quality of video filtering of the 
presentation and reducing a quality of audio decoding of the presentation, wh e r ei n the 
component i s s ele ct e d from a group compr i sing mu l t i p le comprising one of at least three 
components of the multi-component pipeline that are configured to take the corrective 
action in response to a request , wherein the portion comprises one or more succeeding 
samples to the first sample and the second sample. 

21. (Previously Presented) A method as defined in claim 20, wherein the 
processing times of the first and the second samples are determined relative to a single 
component in the multi-component pipeline. 

22. (Previously Presented) A method as defined in claim 20, wherein the 
processing times of the first sample is determined relative to a first component in the 
multi-component pipeline and the processing times of the second sample is determined 
relative to a second component in the multi-component pipeline. 

23. (Previously Presented) A method as defined in claim 20, wherein the 
processing times of the first and the second samples are determined using timing 
information in the first and the second samples. 
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24. (Previously Presented) A method as defined in claim 20, wherein the 
processing times of the first and the second samples are determined using timing 
information in the first and the second samples and a presentation clock. 

25. (Previously Presented) A method as defined in claim 20, wherein the 
timeliness of the sample processing is determined based on: 

a first timing difference between a time specified in a timing value in the first 
sample and a time that the first sample is processed by the component in the multi- 
component pipeline; 

a second timing difference between a time specified by a timing value in the 
second sample and a time that the second sample is processed by the component in 
the multi-component pipeline. 

26. (Previously Presented) A method as defined in claim 20, wherein the 
timeliness of the sample processing is determined based on: 

the first timing error being a difference between a time specified in a timing value 
in the first sample and a time that the first sample is processed by a first component in 
the multi-component pipeline; and 

the second timing error being a difference between a time specified by a timing 
value in the second sample and a time that the second sample is processed by a 
second component in the multi-component pipeline. 
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27. (Currently Amended) A method as defined in claim 20, wherein the 
timeliness of the sample processing is determined by: 

determining the first timing error being a difference between a time specified in a 
timing value in the first sample and a time that the first sample is processed by the 
component in the multi-component pipeline; 

determining the second timing error being a difference between a time specified 
by a timing value in the second sample and a time that the second sample is processed 
by the component in the multi-component pipeline, wherein the second sample is 
processed at a later time than the first sample; and 

determining that timeliness of sample processing is degrading [[if]] based on the 
second timing error [[is]] being greater than the first timing error. 

28. (Currently Amended) A method as defined in claim 20, wherein the 
timeliness of the sample processing is determined by: 

determining the first timing error being a difference between a time specified in a 
timing value in the first sample and a time that the first sample is processed by a 
selected component in the multi-component pipeline; 

determining the second timing error being a difference between a time specified 
by a timing value in the second sample and a time the second sample is processed by 
the selected component, wherein the second sample is processed at a later time than 
the first sample; and 

determining that timeliness of sample processing is degrading [[if]] based on the 
second timing error [[is]] being greater than the first timing error. 
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29. (Previously Presented) A method as defined in claim 20, wherein altering 
the manner in which the component in the multi-component pipeline processes a portion 
of the presentation comprises instructing the component to drop the one or more 
succeeding samples. 

30. (Previously Presented) A method as defined in claim 20, wherein altering 
the manner in which the component in the multi-component pipeline processes the 
portion of the presentation comprises instructing the component to drop each sample in 
a frame of the presentation. 

31. (Original) A method as defined in claim 20, wherein each component 
comprises processor executable instructions executed by a processor. 

32. (Currently Amended) A system, comprising: 
memory; 

one or more processors; 

a plurality of sample processing components operably connected to form a 
pipeline operable to process samples of a presentation , at least three of the sample 
processing components being configured to take corrective action ; and 

a quality manager , stored in the memory and executed by the one or more 
processors, configured to monitor sample processing times in the pipeline and[[,]] based 
on the monitored sample processing times, control a manner in which at least one of the 
sample processing components processes a subsequent portion of the presentation 
the contro lli ng the manner i nc l ud i ng by taking corrective action [[by]] that includes 
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reducing a quality of video filtering of the presentation and reducing a quality of audio 
decoding of the presentation, wh e r ei n the at least one of the sample processing 
components i s s ele ct e d from a group compr i sing mu l t i p le comprising one of at least 
three sample processing components of the pipeline that ar e being further configured to 
receive and process a request from the quality manager to take the corrective action 
and being further configured to relay timing information regarding samples of the 
presentation to the quality manager to facilitate monitoring of the sample processing 
times in the pipeline , wherein the quality manager contro l s th e mann e r to tak e 
determines the corrective action by identifying a difference between a first timing error 
for a first sample and a second timing error for a second sample and determining that 
the sample processing times are degrading when the second timing error is greater than 
the first timing error. 

33. (Previously Presented) A system as recited in claim 32, wherein the at 
least one of the sample processing components comprises a media sink, and wherein 
the quality manager monitors sample processing times at the media sink. 

34. (Previously Presented) A system as recited in claim 32, wherein taking 
the corrective action comprises instructing the at least one of the sample processing 
components to drop one or more samples of the subsequent portion of the presentation. 

35. (Previously Presented) A system as recited in claim 32, wherein taking 
the corrective action comprises instructing the at least one of the sample processing 
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components to drop all of the samples of a frame of the subsequent portion of the 
presentation. 

36. (Previously Presented) A system as recited in claim 32, wherein the 
quality manager controls the manner in which at least one of the sample processing 
components processes the subsequent portion of the presentation based on two or 
more samples of the presentation. 

37. (Previously Presented) A system as recited in claim 32, wherein the 
quality manager monitors sample processing times at a first sample processing 
component and, based on the monitored sample processing time at the first sample 
processing component, controls the manner in which a second sample processing 
component processes the subsequent portion of the presentation. 

38. (Previously Presented) A system as recited in claim 32, wherein the 
quality manager monitors sample processing times at a sink component and, based on 
the monitored sample processing time at the sink component, controls the manner in 
which a codec component processes the subsequent portion of the presentation. 
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39. (Previously Presented) A system as recited in claim 32, wherein the 
quality manager monitors the processing times of two samples at a sink component 
and, based on the monitored sample processing times of the two samples at the sink 
component, requests that the codec component drop at least one frame of the 
presentation. 

40. (Previously Presented) A system as recited in claim 32, further 
comprising a presentation clock associated with the presentation, wherein the quality 
manager monitors sample processing times in the pipeline relative to the presentation 
clock. 

41. (Previously Presented) A system as recited in claim 32, further 
comprising a presentation clock associated with the presentation, wherein a plurality of 
the samples of the presentation comprise associated timing information, and wherein 
the quality manager monitors sample processing times in the pipeline by comparing the 
timing information of the samples to the presentation clock. 

42. (Currently Amended) A computer-readable storage medium having 
computer z executable instructions that, when executed by one or more processors, 
cause the instructions to perform acts comprising: 

determining a first timing value associated with a first sample of a presentation 
being processed by a first component in a pipeline; 

determining a second timing value associated with a second sample of a 
presentation being processed by the first component in the pipeline; 
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determining if the first and second samples are on time by comparing the timing 
value for each of the first and the second sample to a presentation clock associated with 
the presentation to determine if the first and second timing values indicate degrading 
timeliness; and 

requesting a second component in the pipeline to take corrective action by 
dropping one or more subsequent samples of the presentation, to reduce a quality of 
video filtering of the presentation, and to reduce a quality of audio decoding of the 
presentation when the timeliness is degrading, wherein the first and second 
components ar e s ele ct e d from a group compr i s i ng comprise two of at least three a 
p l ura li ty of components of the pipeline that are configured to take the corrective action. 

43. (Currently Amended) A computer-readable storage medium as recited in 
claim 42, wherein the timing value for the first sample is included in the first sample and 
the timing value for the second sample is included in the second sample. 

44. (Currently Amended) A computer-readable storage medium as recited in 
claim 42, wherein the first component is a sink component. 

45. (Currently Amended) A computer-readable storage medium as recited in 
claim 42, wherein the second component is a codec. 
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46. (Currently Amended) A computer-readable storage medium as recited in 
claim 42, wherein the first component is a sink component and the second component 
is a codec. 



47. (Currently Amended) A computer-readable storage medium having 
computer z executable instructions that, when executed by one or more processors, 
cause the instructions to perform acts comprising: 

determining sample timing information associated with at least two samples of a 
presentation processed by a first component in a pipeline; 

determining if the sample timing is degrading by comparing the timing information 
associated with the at least two samples to a presentation clock associated with the 
presentation, the determining further comprising determining a difference between a 
first timing error for a first sample and a second timing error for a second sample; and 

instructing at least one component in the pipeline to alter a manner in which the 
at least one component processes a portion of the presentation when the sample time is 
degrading , th e a l t e r i ng i nc l ud i ng by taking corrective action by r e duc i ng to reduce a 
quality of video filtering of the presentation and r e duc i ng to reduce a quality of audio 
decoding of the presentation, the sampling time being degrading when the second 
timing error is greater than the first timing error, wherein the at least one component is 
s ele ct e d from a group compr i s i ng a p l ura li ty of comprises one of at least three 
components of the pipeline that are configured to take the corrective action. 
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48. (Currently Amended) A computer-readable storage medium as recited in 
claim 47, wherein sample timing information is included in associated samples. 

49. (Canceled) 

50. (Currently Amended) A computer-readable storage medium as recited in 
claim 47, wherein the at least one component is a codec. 

51. (Currently Amended) A computer-readable storage medium as recited in 
claim 42, wherein the first component is a sink component and the second component 
is a codec. 

52. (Previously Presented) A method as recited in claim 1 , 

wherein the portion of the presentation comprises a third sample and a fourth 
sample. 

53. (Previously Presented) A method as recited in claim 13, further 
comprising: 

if the second timing error is greater than the first timing error, taking the 
corrective action, wherein the portion of the presentation comprises two or more 
succeeding samples to the two or more samples. 
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54. (Previously Presented) A method as recited in claim 53, wherein the two 
or more succeeding samples are not consecutive samples. 

55. (Previously Presented) A method as recited in claim 20, wherein the 
portion of the presentation comprises a third sample and a fourth sample. 

56. (Previously Presented) A method as recited in claim 28, further 
comprising: 

if the timeliness of the sample processing is degrading, taking the corrective 
action on the portion of the presentation, wherein the portion of the presentation 
comprises two or more succeeding samples of the first sample and the second sample. 

57. (Previously Presented) A method as recited in claim 56, wherein the two 
or more succeeding samples are not consecutive samples. 

58. (New) A computer-readable storage medium as recited in claim 42, 
wherein the plurality of components of the pipeline are each configured to take the 
corrective action in response to a request. 

59. (New) A computer-readable storage medium as recited in claim 47, 
wherein the plurality of components of the pipeline are each configured to take the 
corrective action in response to a request. 
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